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ABSTRACT 

How does the clustering of galaxies depend on their inner properties like morphological type and 
luminosity? We address this question in the mathematical framework of marked point processes and 
clarify the notion of luminosity and morphological segregation. A number of test quantities such as 
conditional mark-weighted two-point correlation functions are introduced. These descriptors allow for 
a scale-dependent analysis of luminosity and morphology segregation. Moreover, they break the degen- 
' eracy between an inhomogeneous fractal point set and actual present luminosity segregation, 

fvq \ Using the Southern Sky Redshift Survey 2 (da Costa et al. 1998, SSRS2) we find both luminosity and 

morphological segregation at a high level of significance, confirming claims by previous works using these 
data (Benoist et al. 1996; Willmer et al. 1998). Specifically, the average luminosity and the fluctuations in 
the luminosity of pairs of galaxies are enhanced out to separations of 15/i _1 Mpc. On scales smaller than 
\Q • 3/i _1 Mpc the luminosities on galaxy pairs show a tight correlation. A comparison with the random-field 

model indicates that galaxy luminosities depend on the spatial distribution and galaxy-galaxy inter- 
actions. Early-type galaxies are also more strongly correlated, indicating morphological segregation. 
The galaxies in the PSCz catalog (Saunders et al. 2000) do not show significant luminosity segregation. 
This again illustrates that mainly early-type galaxies contribute to luminosity segregation. However, 
based on several independent investigations we show that the observed luminosity segregation can not 
be explained by the morphology-density relation alone. 
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£C) • Subject headings: methods: statistical - large-scale structure of universe - galaxies: clusters - galaxies: 

' fundamental parameters (classification, luminosities) 

O ' 

O 1 L INTRODUCTION 

■ The geometrical properties of the large-scale structure in the Universe are a common test for cosmic structure formation 
Oh theories. However, comparisons between analytical models and observational data suffer from the fact, that theoretical 

predictions refer to mass correlations whereas in galaxy catalogs only luminous matter is observed. This gap gives rise to 
£^ ■ the bias problem and is usually filled using biasing schemes. Mostly, these schemes relate properties of the density contrast 
^ | field to the distribution of the galaxies, thus combining descriptors of a random field with point process characteristics. 
d • Due to the nature of the dark matter, only indirect methods are feasible to address the bias problem empirically. In this 
line of thought, it seems promising to ask whether the clustering properties of galaxies depend on their mass, luminosity 
or morphological type. The idea behind this search for luminosity and morphology segregation is that different galaxy 

■ subpopulations may trace the dark matter distribution on a different level. 

?H Empirical investigations concerned with this problem were mainly carried out in two directions: 

a ; 

• The two-point correlation function was calculated for a series of volume-limited subsamples from galaxy surveys. 
A difference in the amplitude of the two-correlation function between such samples was interpreted as an 
indication of luminosity or morphology-segregation. For luminosity segregation see e.g., Ostriker & Turner (1979); 
Hamilton (1988); Dominguez-Tenreiro & Martinez (1989); Benoist et al. (1996); Willmer et al. (1998). The void 
probability and cross-correlation functions have been used by Maurogordato & Lachieze-Rey (1987) and Valotto 
& Lambas (1997). For morphology segregation see e.g., Dominguez-Tenreiro et al. (1994); Hermit et al. (1996). 
These investigations are sensitive to segregation effects on scales roughly between 1 and 10/i _1 Mpc. However, 
Coleman & Pietronero (1992) gave an alternative explanation of the rising amplitude in terms of a fractal galaxy 
distribution, without any luminosity-dependent clustering. 

• Dressier (1980) showed that in clusters of galaxies the morphological type of a galaxy is depending on the local 
(surface) density; this is called the morphology-density relation. For mainly spherical clusters, where the local 
density is closely related to the radial distance from the cluster center, this translates into the Butcher & Oemler 
(1978) effect. For more recent accounts of the morphology-density relation see Caon & Einasto (1995); Dressier 
et al. (1997); Andreon et al. (1997). Most of these investigations focussed on the morphology-density relation 
inside clusters, hence on scales smaller than 1.5/i _1 Mpc. But the morphology-density relation can be observed 
also in groups of galaxies (Postman & Geller 1984; Maia & da Costa 1990) and for dwarf galaxies in the field 
(Binggeli et al. 1990). 
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With the first method, one compares two-point correlation functions, whereas with the second, one considers the relation 
between the local number density and the local morphology, i.e., a comparison of one-point densities. Both methods rely 
on unweighted descriptors. 

The observations of luminosity segregation or the morphology-density relation were complemented by theoretical con- 
siderations. Motivated by the offset between the galaxy-galaxy and the cluster-cluster correlation functions, Kaiser 
(1984) and Bardeen ct al. (1986) suggested that clusters may be understood as peaks in the density field. Starting from 
a Gaussian random field they showed how the amplitude of the correlation function increases with the threshold imposed 
on the initial density field, i.e., with the height of the peaks in the density field. This also provided an explanation for 
the morphology-density relation (Evrard et al. 1990). 

Other authors developed a conceptual framework to describe the bias (see e.g., Coles 1993, Dekel & Lahav 1999, and refs. 
therein). Within these biasing schemes, characteristics of the galaxy point pattern are connected with descriptions of the 
density field - often the mass density contrast and the galaxy over-density are compared. The relation is assumed to be 
(non-) linear and either deterministic or stochastic (Dekel & Lahav 1999). More involved biasing schemes were considered 
to facilitate the extraction of reasonable galaxy catalogs from TV-body simulations (see e.g., Kates et al. 1991, Weifi & 
Buchert 1993, Kauffmann et al. 1997). 

In this paper, we introduce a new method to handle the bias problem. Our approach complements both the more 
observational methods and the analytical and theoretical treatments. We understand the galaxies with their intrinsic 
properties as a realization of a marked point process. Using conditional weighted correlation functions, we put an 
intermediate step in between the pure point process statistics and the statistics of random fields. In our description 
stochasticity is present from the very beginning. It provides us with stochastic models which enable us to exclude certain 
families of models for the luminosity distribution of galaxies. 
More precisely, the aim of our paper is twofold: 

On the one hand, we want to clarify the notion of luminosity /morphology-dependent clustering by discussing this task 
in the mathematical framework of marked point processes (Sect. 2). This allows us to introduce a new class of indicators 
sensitive to luminosity segregation (Subsect. 3.1) and to discuss models for marked point patterns (Subsect. 3.2 and 
Subsect. 6.1). Methods similar in spirit are the cross-correlation function and luminosity-weighted correlation functions 
considered by Alimi et al. (1988), Borner et al. (1989), Valls-Gabaud et al. (1989), and Tegmark & Bromley (1999). Our 
methods allow for a study of the interplay between the spatial clustering and the luminosity and morphology distribution 
of the galaxies, complementing the characterization of the purely spatial distribution of the galaxies. 

On the other hand, we address the empirical question, whether the luminosities or morphological types of galaxies 
depend on their spatial distribution by analyzing the SSRS2 catalog (da Costa et al. 1998) in Sect. 4. Our results show a 
significant scale-dependent luminosity and morphological segregation. To understand the data more closely we compare 
our results with the random field model. The comparison with galaxy samples from the IRAS 1.2Jy (Fisher et al. 1995) 
and the PSCz (Saunders et al. 2000) strengthens our conclusions. 

In Sect. 5 we will discuss the usual way of looking for luminosity segregation via the amplitude of the correlation 
function in the framework of marked point processes. The criticism by Coleman & Pietronero (1992) is reviewed and we 
show that this degeneracy between a fractal spatial distribution and luminosity segregation is not encountered if one uses 
the mark-correlation functions we proposed. This strengthens the conclusions of our empirical work in Sect. 4. 

Investigations inside clusters of galaxies gave clear evidence for the morphology-density relation (Dressier 1980). In 
Sect. 6 we however show that the observed luminosity segregation may not be explained by the spatial interaction of early- 
and late-type galaxies alone. Luminosity segregation is already present in the subsamplc consisting only of early-type 
galaxies. 

In Sect. 7 we summarize and provide an outlook. Technicalities concerning the estimation of mark-correlation functions 
are left to Appendix A. 

2. MARKED POINT DISTRIBUTIONS 

Consider a set of points X = {x^}^ given by the spatial coordinates £ R 3 of the galaxies inside a sample geometry 
V. Additionally to their positions in space we know intrinsic properties of the galaxies like their luminosity, mass, 
morphological type etc. Formally, we assign to each point x$ a mark rm, e.g., the luminosity of the galaxy rrii = Li, 
and obtain the marked point set X M = {(x^mi)}^. We are not limited to continuous marks like the luminosity, also 
discrete marks like morphological types (e.g., spiral or elliptical) can be used. The description of the galaxy distribution 
in a statistical way that we will propose in this article, rests on the assumption that the empirical data points may be 
considered as a realization of a marked point process. Formally, X = {x i }^ 1 and M = {mi}f =1 may be thought of as 
realizations of a point process each, which may be characterized by the usual point process statistics. Physically, however, 
we are interested in the interplay between the spatial statistics and the mark distribution, which is expressed in quantities 
combining information on the space and the mark distribution. 

The second-order theory of marked point processes was developed in detail by Stoyan (1984) where also a mark- 
weighted conditional correlation function was introduced (see also Stoyan & Stoyan 1994). Some aspects have been also 
discussed by Peebles (1980). 

2.1. One-point properties 

A point process may be characterized by its moments. For a homogeneous spatial point distribution the first moment is 
the mean number density p, which may be estimated with N/\T>\, where \V\ is the volume of the sample and N the number 
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of points inside V. Let pf ! (m)dm denote the probability that the value of a mark lies within the interval [to, to + dm], 
then the mean mark to and the variance of the marks V are given by 

to = J dm /of f (m)m, and V = J dm p^ 1 (m) (to — to) 2 , (1) 

which may be estimated by 



1 N 1 / N _\ 

-X>, and j^-j [ Yy^Nm 2 ] , 



respectively. 

For a homogeneous marked point process, the joint probability pf M (x, m)dVdm of finding 3 a point at position x with 
mark to, splits into a space-independent mark probability and the constant mean density: p^(m)dTO x pdV. In general, 
the mark distribution p^ is not homogeneous. Note that this notion of independence does not rule out luminosity 
segregation at all and seems a physically justified assumption, since it simply requires that no region of space has an a 
priori specified mark distribution different from that one of another region. 

2.2. Two-point properties 

The second-order properties of the spatial distribution of the point set X are fully specified by the product-density 
pf (xi, x 2 )dVidV2 giving the probability of finding a point at xi and another point at x 2 . For a stationary and isotropic 
point distribution we have with r — |xi — x 2 

pf(xi,x 2 )=p 2 (l+£(r)) (2) 

with the two-point correlation function £(r). Similarly, second-order properties of the marked point set X M are fully 
specified by the mark product-density: 

pf M ((xi,TOi), (x 2 ,to 2 )) dVidTOi dV 2 dTO 2 (3) 

is the joint probability of finding a galaxy at xi with the mark toi and another point at x 2 with the mark to 2 . Hence the 
(spatial) product-density pf (xi,x 2 ) is the marginal density 

P 2 (xi,x 2 ) = J dmi y dTO 2 pf M ((x 1 ,TO 1 ), (x 2 ,to 2 )). (4) 

With an appropriate chosen integration measure similar definitions apply for discrete marks. 
Now consider a finite domain V. The normalization of pf is given by 

Af 2 = f dxf f dxl pi (xi,x 2 ) = E[N(N - 1)], (5) 
Jv Jv 

with N the number of points of one realization inside V, and E the mean value over several realizations. 
Respecting this normalization, a marginal product density for the marks can be defined by 

p¥ (mi.ma) = jj-J^dx\ J^dxl pf M ((x 1; mi), (x 2 , to 2 )). (6) 

/)f(mi, TO 2 )dTOidm 2 quantifies the probability to find the marks mi and m 2 at two given points in the distribution. 
Mathematically, p 2 w (toi,to 2 ) quantifies a real two-point property. Physically, however, we expect - at least in our case - 
that intrinsic correlations in mark space are not present, i.e., that 

p 2 M (mi,m 2 ) = pf(mi)pf(m 2 ). (7) 

Otherwise the probability of finding a galaxy with mark to, in a fixed sample would depend on the other marks regardless 
how distant they are, a consequence which may seem reasonable in biosciences (epidemiology) but not in our case of large 
galaxy surveys. In other words, spatial mark correlations may be present, but globally the presence of a mark with value 
to in the sample does not prearrange the values of the other marks. Typically, the one- point mark distribution pf 1 is 
inhomogeneous in mark-space. Therefore, one cannot check the relation (7) from one realization only; several independent 
samples are needed. In future redshift surveys it may be possible to extract approximately independent subsamplcs 
seperated by a large distance, allowing for such a check. Throughout this paper, we will adopt the assumption (7). 

2.3. Mark correlations depending on the spatial distance 

In the following we want to know, whether the clustering in space and the luminosity distribution are correlated. We 
define the conditional mark density: 

forp 2 (xi,x 2 )^0, (8) 
otherwise . 

3 For the sequel we speak for reasons of simplicity of "finding at x with mark m" instead of "finding in a volume element dV at position x 
with mark in the range [m,m + dm]". 
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For a stationary and isotropic point distribution, ^(mi, m2|xi, X2) is the probability density of finding the marks mi 
and m 2 at two galaxies located at xi and x 2 , respectively, under the condition that galaxies at these positions are present 
in the data. For the following, we assume that this quantity is only a function of the galaxy distance r = |xi — x 2 |: 
M 2 (mi,m 2 \r). This assumption expresses a sort of homogeneity and isotropy, however, it does not presuppose a well- 
defined mean density and is thus only a weak requirement. 
The full mark product-density can be written as 

P2 M ((xi,mi), (x 2 ,m 2 )) = Ai 2 (mi,m 2 |xi,x 2 ) pf (xi,x 2 ). (9) 
M2(mi, m 2 |r) is a function depending on three variables and is therefore hard to estimate. With the mark-weighted 
correlation functions and the discrete mark-correlation function we further distill the information as discussed in Subsec- 
tion 3.1. 

If the distribution of the marks is independent of the distribution of the points, the conditional mark density becomes 
independent of r: 

M 2 (m u m 2 \r) = pf (mi)pf (ma), (10) 
Intuitively, this independence may be understood in the following way: After having distributed galaxies in space, we 
choose marks (as a realization of a second independent stochastic process) and distribute them randomly without any 
regard to the clustering of the galaxies. 

Equation (10) is the basic assumption behind projection formulas like Limber's equation (Peebles 1980). If, on the other 
hand, M. 2 (rn\,m 2 \r) does depend on r, we speak of e.g., mark segregation: The probability of observing two marks m\ 
and m 2 (e.g., luminosities) on the galaxies at xi and x 2 varies with the separation r of these two galaxies. 
Note, that for every empirical dataset of marked points (which we may think of as realization of a marked point process) 
we can artificially construct another dataset with the same spatial features showing no mark segregation by redistributing 
the marks to the points randomly. This boostrap resampling strategy for the marks provides a method for testing the 
statistical significance of mark correlations. 

2.4. Spatial correlations depending on the marks 

There are complementary definitions of this sort of independence or luminosity segregation. For example, we can think 
the other way round and define a conditional density that there be two galaxies at xi and X2, under the condition that 
their marks be mi and m 2 : 

WT ^ T) forA/2p 2 (mi,m 2 )^0, (n) 

otherwise , 

with A/2 given in Eq. (5). If the conditional space correlation is independent of mi and m 2 , then <S 2 (xi, x 2 |mi, m 2 ) = 
pf (xi, x. 2 )/Af 2 . In the case of luminosity segregation, on the other hand, the values of the marks influence the spatial 
clustering. Using £2 we will discuss the usual way of looking for luminosity segregation in Subsect. 5.1. 

2.5. n-point properties 

For completeness we mention that n-point-properties may be discussed in the same way. Basic quantities arc the 
n-point product densities pf M ((xi, mi), . . . ,(x„,m„)) and the conditional densities A4 n {mi, . . . ,m„|xi,... ,x„). At 
this level the issue may be re-discussed, whether the mark distribution depends on the spatial clustering. 

Robust statistics for the clustering of galaxies in space, incorporating higher-order correlations, are the J-function 
(van Lieshout & Baddeley 1996, Kerscher 1998, Kerscher et al. 1999) and the Minkowski functional (Mecke et al. 1994, 
for a review see Kerscher 2000). A first extension of the J-functions to discretely marked point sets is discussed by van 
Lieshout & Baddeley (1997). The application to galaxy catalogs and the generalization for continuous marks is currently 
under investigation. 

3. MARK-WEIGHTED CONDITIONAL CORRELATION FUNCTIONS AND MODELS FOR MARKED POINT DISTRIBUTIONS 

Since the joint space and mark product-density pf M and the conditional mark density Ai 2 depend on three variables 
at least, they are not easy to handle. Therefore, we discuss quantities accessible both to straight-forward interpretation 
and to numerical estimation. Particularly, we investigate the mark-weighted conditional densities. 

3.1. Mark-weighted conditional correlation functions 

For a non-negative weighting function /(mi, 7712) we define the average over pairs with separation r: 

(/)p ( r ) = J dm i y dm 2 /(mi,m 2 ) M 2 (mi,m 2 \r). (12) 

(/)p ( r ) is the expectation value of the weighting function / (depending only on the marks), under the condition that we 
find a galaxy-pair with separation r in the data. With this definition we separate the mark correlation properties from 
the spatial clustering properties of the underlying point-distribution, as can be seen directly from 

/A ( x _ Jdmi Jdm 2 /(mi,m 2 ) pf M ((xi, mi), (x 2 , m 2 )) 

WpW- p s {r) W 

for pf (r) 7^ 0. We are free to choose appropriate weighting functions adopted to our problem. In the following we discuss 
common choices from the literature and introduce some new ones. 

4 The notation M.2{mi, m.2\r) is somehow imprecise, since it does not remind us of the fact that the marks refer to given points xi and X2. 
For simplicity, we do not use a more accurate notation like A / (2(mi (xi), m2(x2)|r). 
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3.1.1. Continuous marks 

Using several positive weighting functions we construct statistical indicators to investigate the mark correlation prop- 
erties of a point set (see also Stoyan & Stoyan 1994 and Schlather 1999, we assume that the marks are positive numbers): 

1. At first we consider the mean mark: 

Mr) . <-.+ff,M (14) 

k m equal unity indicates the absence of mark segregation. A preferred clustering of marks e.g., m > m at a scale 
r can be concluded from k m (r) > 1. 

2. Closely related is Stoyan's fc mm -function 5 (Stoyan & Stoyan 1994): 

k mm (r) = (15) 
m 

With k mm we investigate the square of the geometric mean of the marks on points at a distance of r. Therefore, a 
preferred clustering of marks at a scale r can be inferred from k mm (r) > 1 similar to k m . Note that if the mark is 
the mass of a galaxy, k mm may serve as an estimator for the conditional mass correlations E[p(0)£>(x)]//9 2 (0, x), 
where g(x) is the mass-density at position x, thus it quantifies the ratio between galaxy and mass correlations. 

3. The mark variogram (Walder & Stoyan 1996) is defined by 

7 (r) = (Krrn - m 2 ) 2 ) p (r) = (mf) p (r) - (m 1 m 2 ) P (r). (16) 

7(r) equals the variance V of the mark distribution, if mark segregation is absent; it exceeds V at some scale r, if 
points that are about r apart from each other, tend to have very different marks. 

4. Another tool for investigating the variance of the mark distribution is the mark covariance function (Cressie 1991) 

cov(r) = (mim 2 ) P (r) - (mi) P (r) (m 2 } P (r) = (mim 2 ) P (r) - (mi) P (r). (17) 

Thus, luminosity segregation can be detected by looking whether cov(r) does significantly differ from zero for 
some r. 

5. Both 7(r) and cov(r) mix the two-point and one-point fluctuations of the mark distribution. To quantify the 
fluctuations of the mark at one point only, given there is another point at distance r, we suggest to use 

var(r) = ((rm - (mi) P (r)) 2 ) p (r). (18) 

From Eq. (16) and (17) one directly obtains 

var(r) = j(r) + cov(r). (19) 

6. Closely related to cov(r) is the mark-correlation function of Isham (1985) 



^ 2 

cor(r) = V " 1 "^ PVJ V '7 P v/ = ^f4, (20) 

(m 2 ) p (r) - ( mi ) (r) var(r) 



(mira 2 ) p (r) - (mi) p (r) _ cow(r) 



the covariance function divided by the fluctuations of the mark. 

Schlather (1999) showed that there is an ambiguity in the definitions of these mark characteristics at r equal zero, but 
there is no problem for r > 0. Since we always have to use a finite and non-zero r to estimate these mark characteristics, 
this ambiguity is a technical point we do not need to consider further. As another characteristic for marked point 
distributions, Capobianco & Renshaw (1998) consider the extension of the k mm function on a two-dimensional grid. 

3.1.2. Discrete marks 

To investigate the correlation properties between galaxies of different morphological types the marks m, are chosen out 
of a finite range of attributes m, S {t a }a=i- We also could use other intrinsic properties, like spectral features etc. of the 
galaxies to define these discrete marks. Similarly, a finite binning may be used for continuous marks. Consider pairwise 
disjoint bins I a in luminosity space, then the mark is chosen to be trii = t a if the luminosity of the galaxy is £ I a . 

For discrete marks the following symmetric weight functions for a, /3 = 1, . . . , A are appropriate: 

/w?( m ii m 2) = 8 mita 5 m2t/3 + (1 - 5 a /3)5 m2ta 5 mit/3 , (21) 

where the Kronecker 5 mi t a equals unity if mi = t a and zero otherwise. According to Eq. (12) we consider the (normalized) 
conditional cross-correlation functions 

Cw,(r) = (/t ot(J > p (r). (22) 

5 Also called (normalized) mark-correlation function, see however the comments by Schlather (1999). 
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Clearly, Y, a =i S/3= a ft a ,t = 1 and therefore also 

A A 

£E C W» = 1 (23) 

a=l fj=a 

for all r. If the marks are independent on the distribution in space one can show that 

C ta ,t (r) = 2 y " for i a ^ t^, and C to , ta (r) = ^f, (24) 

with the number density pt Q of points with mark t a . 

Summarizing, there is a variety of test quantities which allows us to search for luminosity segregation in real data. 
Note that these quantities are applicable to a single data set without the need of constructing a series of volume-limited 
subsamples. With these methods we are able to gain new insights into the luminosity and morphological dependent 
clustering of galaxies (Sect. 4). As we will show in Subscct. 5.3, these methods break the degeneracy between fractal 
spatial structure and luminosity segregation. 

3.2. Marked Poisson processes 

Before applying these test quantities to real data we explain their properties with a simple model, where the marks are 
artificially constructed from the spatial pattern. Other models are discussed in Subsect. 4.2 and Subsect. 6.1. 

We start with Poisson-distributed points Xj, with number density p and assign to each point the mark m, = Ni(R), 
where Ni(R) is the number of other points within a sphere of radius R around the point Xj. Explicit formulas for j(r) and 
k mm (r) were derived by Walder & Stoyan (1996). In Fig. 1 we compare numerical simulations with the theoretical curves. 
Points, which arc members of a pair with small separation, are on average situated in over-dense regions, have more 
neighbors and therefore get higher marks. This is reflected by k m (r) and k mm (r) larger than unity on small scales (k m (r) 
and k mm (r) indeed show a jump at r = R). Since nearby points get similar marks, the mark variogram is suppressed on 
small scales, which can be seen directly from the reduced 7(7") on small scales. However, the mean fluctuations of the mark 
at one point arc not influenced by the presence of nearby other points for a Poisson process, and consequently var(r) — V . 
The strong correlation of marks on small scales can be seen also from the the covariance cov(r) and correlation cor(r). 
Empirically, both cov(r) and cor(r) and also k m (r) and k mm (r) exhibit the same information content. We also found this 
in our analysis of the galaxy catalogs in Sect. 4. Moreover, j(r) may be expressed with cov(r) and var(r) (Eq. (19)). 
Therefore, we will focus in the following only on k mm (r), var(r) and cov(r). 

4. LUMINOSITY AND MORPHOLOGICAL SEGREGATION IN THE GALAXY DISTRIBUTION 

Having clarified the basic notion of luminosity segregation, we now apply the above-defined characteristics to real data 
and discuss the empirical question whether there is evidence for luminosity segregation in the large-scale structure of the 
galaxy distribution. We study luminosity- and morphology-dependent clustering in the Southern Sky Redshift Survey 2 
(SSRS2, da Costa et al. 1998). This survey is 99% complete with a limiting magnitude of tub — 15.5 within the region 
—40° < 8 < —2.5° and b < —40° and the region 8 < 0° and b > 35°. We will focus on a volume-limited subsample with 
100/i~ 1 Mpc depth with 1179 galaxies. We obtained the same results looking at samples with different limiting depths 
(see Sect. 4.5). In Sect. 4.6 we compare with the results from IRAS selected samples. 

4.1. Luminosity as a continuous mark 
For a galaxy at a distance r, = |xj| from our galaxy with a magnitude mag(x^) the luminosity Lj is proportional to 

2 1Q -0.4 mag(x,). g incc 

we look at normalized quantities, the absolute scaling of the luminosity is unimportant, and we 
assign to a galaxy at x^ the mark m, — rf 10~ ' 4 ma s( x i) To estimate k mm , var, and cov we show the results obtained 
with the estimator without boundary corrections, which is distinguished by its simplicity and unbiasedness. The other 
estimators gave fully consistent results. A systematic examination of the estimators further justifying this approach is 
given in Appendix A. The errorbars for the case of no luminosity segregation were estimated by randomly redistributing 
the marks of the galaxies, keeping their positions in space fixed. 

Already at a first glance Fig. 2 reveals that all test quantities show evidence of luminosity segregation at a high level of 
significance, especially k mm and var. The increasing k mm towards small scales supports the hypothesis that bright galaxies 
exhibit stronger clustering than the dim ones (k m shows the same feature). The strong signal of var is a result which 
escaped previous analyses; the luminosity fluctuations of galaxies with a neighbor closer than 15/i _1 Mpc are enhanced, 
showing that the luminosity distribution is broader for these galaxies in addition to their higher mean luminosity as 
detected by k mm . Both k mm and var show a signal out to 15/i _1 Mpc, indicating that luminosity segregation is not only 
confined to clusters of galaxies. The covariance cov measures the correlations between the luminosities on both galaxies. It 
shows only weak evidence for luminosity segregation on large scales, however, on scales smaller than 3/i _1 Mpc, the cov > 
indicates an excess correlation between the luminosities of two galaxies: Close pairs of galaxies tend to assume similar 
luminosities. At r ~ 10/i Mpc, k mm and especially var show a second peak, indicating that the average luminosity of 
the galaxy pairs and the fluctuations of the luminosity on each galaxy are enhanced, cov shows a negative minimum 
corresponding to an increased diversity between the luminosities of the two galaxies. Clearly this is at most a two-cr 
result, however these features also appear in volume-limited samples with different depths. 
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Fig. 1. — The k m (r), the fc mm (r), the normalized -f(r)/V and var(r)/V, and the covariances cov(r) and corir) for a marked Poisson process 
with number density of 1000 inside the unit box. The points were marked with iVi(O.l). The dashed line is the theoretical result, the shaded 
area marks the la range estimated from 5000 simulations, and the dotted line is the result for randomly distributed marks, r is given in units 
of the box-length. 
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4.2. The random field model 

To understand the data in more detail we compare with a particular model for marked point processes which shows 
mark segregation (Walder & Stoyan 1996). In the random field model the marks m, are assigned to the points of a 
(unmarked) point process using an independent random field tt(x): m, = m(x,). This is a basic model in geo-statistics 
(see e.g., Cressie 1991). If the point process and the random field arc homogeneous, so is the marked point process. In 
this case one obtains for r > (Walder & Stoyan 1996) 

k mm (r) = ^E[n(0)n(r)], (25) 
m 

and 

7 (r) = iE[W0)- U (r)) 2 ]. (26) 

Here, E is the average over several realizations of the random field, thus E[u(0)u(r)] is the covariance of the field. Using 
well-known properties of random field covariances (Adler 1981; Walder & Stoyan 1996), a relation for the random field 
model can be derived: 

7(r) = E [u(0f] -m 2 k rnm (r) = V + m 2 - m 2 k mm (r) . (27) 

This enables us to test whether a marked point process may be understood in terms of the random field model. - Note, 
that in the random field model the marks are given by an underlying random field, which is not affected by the spatial 
distribution of the points. This does not cover the general case, where the marks on the points may be influenced by 
spatial interactions of the points, as in the marked Poisson process in Sect. 3.2. Indeed, the relation (27) is not fulfilled 
for this model as inferred directly from Fig. 1. 

From Fig. 3 we see that for the galaxy distribution the estimated variogram j(r) and the 7 rf (r), calculated from Eq. (27), 
show the opposite behavior. Hence, the luminosity segregation observed in this galaxy sample can not be described by 
a random field model. Therefore, the luminosity of a galaxy does not trace an independent luminosity field, but rather 
depends on the spatial interactions with other galaxies. Such an interaction is expected physically in clusters of galaxies, 
where galaxies merge. Beyond cluster scales this "interaction" may be caused by a common origin in the same large-scale 
feature of the density distribution. 

4.3. Luminosity classes as discrete marks 

Now we split the volume-limited sample with lOO/i Mpc depth into three distinct subsamples with 393 galaxies each. 
These subsamples consist of luminous, medium and dim galaxies, labeled with I, m and d respectively. The conditional 
cross-correlation functions Cdd, Cdm, Cm, C mm , C m i, Cu are shown in Fig. 4, estimated from the volume-limited sample 
with 100/i _1 Mpc depth using the estimator employing no boundary correction. They show that our above interpretation 
of k mm (r) based on Fig. 2 points into the right direction. At scales up to 5/i _1 Mpc, the bright galaxies cluster more 
strongly than the other ones, this effect is at the expense of the dim galaxies, the galaxies with medium luminosities do 
not contribute to luminosity segregation. However, an analysis based on luminosity classes cannot explain the strong 
peak of var and cov at small scales since both embody fluctuations of the marks. Note, that this partition in luminous, 
medium and dim galaxies is arbitrary and neither physically justified nor suggested directly by the data. We also divided 
the sample into two luminosity classes of equal size. Here the cross-correlations are all compatible with the randomized 
results and no luminosity segregation seems to be present. This emphasizes the discriminative power of the continuous 
mark correlation functions: The conditional cross-correlation functions for the binned marks may be blind to luminosity 
segregation. But with a carefully adapted binning they are able to strengthen the conclusions obtained with the continuous 
mark-correlations functions. 




5 10 15 20 5 10 15 20 5 10 15 20 

r [Mpc/h] r [Mpc/h] r [Mpc/h] 

Fig. 2. — The mark-correlation functions for a volume-limited subsample of the SSRS2 with a depth of 100fe _1 Mpc. The shaded areas 
denote the 1-cr error for randomized marks estimated from 1000 realizations. 
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4.4. Morphological types as discrete marks 

Using the morphological type of a galaxy as a mark we investigate morphological segregation using the conditional 
cross-correlation functions defined in Sect. 3.1.2. 

The morphological classification of the galaxies in the SSRS2 catalog was compiled from different sources. So, only wide 
classes will give reliable results (da Costa et al. 1998). We compare the clustering properties of two classes, consisting 
of spiral, irregular and peculiar galaxies, labeled with I (late type), and elliptical and lenticular galaxies, labeled with e 
(early type). We discard the small fraction of unclassified galaxies. In Fig. 5 the conditional cross-correlation functions 
C ee (r), C e i(r), Cu(r) are shown, estimated from the volume-limited sample with 100/i _1 Mpc depth, using no boundary 
correction. 

The results demonstrate, that the clustering properties of the SSRS2-galaxies depend on morphology. Although the 
late-type galaxies predominate the catalog, especially the small-scale clustering is disproportionally due to pairs of early- 
type galaxies. In Subsect. 4.3 we saw that the luminous galaxies tend to cluster stronger. At this point, the question 
arises, whether the morphology segregation is a possible explanation of the luminosity segregation or vice versa. We will 
discuss the connection between both sorts of mark segregation in Sect. 6.1. 

4.5. Error estimates 

In the preceding sections we have shown results for a volume-limited sample with 100/i _1 Mpc depth. We also consid- 
ered volume-limited samples with a limiting depth of 60/i _1 Mpc, 80ft. -1 Mpc and 120/i~ 1 Mpc, all giving similar results. 
Moreover, the results do not change if we use luminosity distances instead of Euclidean and apply a type-dependent 
if -correction as used by Benoist et al. (1996) (see Fig. 6). 

Systematic errors may occur, since we performed our analysis in redshift space, i.e., we estimate the luminosity L of 
a galaxy using its redshift z: L oc z 2 io~ - 4ma s. Therefore peculiar velocities not only change the spatial correlations, 
but also the values of the marks may be biased in a systematic way. It is difficult to correct for such an effect, since 
in-fall and streaming motions lead to correlated peculiar velocities. To estimate the order of magnitude of this error we 
randomly add a line-of-sight peculiar velocity to each galaxy following a Gaussian distribution with zero mean and a 
width of 300km/s in agreement with the value for the pairwise velocity dispersion in the SSRS2 given by Marzke et al. 
(1995). In randomizing the radial velocities independently we overestimate this error since correlated pairs are eventually 
torn apart 6 . Repeating this procedure several times we can show that the mean values of k mm , var and cov do not change 
compared to the results in Fig. 2. The additional fluctuations introduced by this procedure are smaller than the statistical 
errors quantified by randomizing the marks, as can be seen in Fig. 6. Both k mm and var show a signal outside the one-o- 
range of this luminosity error combined with the statistical errors, whereas cov is becoming marginally consistent. 

Note, that in volume-limited samples a special sort of Malmquist-bias may influence the luminosities: The luminosities 
are estimated using the flux and the redshift as the distance indicator. Hence the distance is influenced by the individual 
peculiar velocity of the galaxy. Consider a shell at distance r. For geometrical reasons more galaxies from the outer side 
get scattered into the shell than galaxies get scattered outside. Hence, in the mean more galaxies are assigned too small 
distances resulting in underestimated luminosities. Considering only galaxies with a distance smaller than 90/i~ 1 Mpc in 
the volume-limited sample with 100/i _1 Mpc depth we obtain nearly identical results for the mark-correlation functions. 
Therefore, this sort of bias does not affect our analysis. 

4.6. IRAS selected galaxies 

6 In adding random peculiar velocities we also account for possible errors within the measurements of the rcdshifts, which are in fact much 
smaller than the imprints of peculiar velocities. 




Fig. 3. — Both the normalized variogram y(r)/V (solid line) and the normalized 7 rf (r)/V (dashed line), calculated according to Eq. (27) 
are shown. The shaded area is marking the \—a region for "f(r)/V with randomized marks. 
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Fig. 4. — The conditional cross-correlation functions of dim (d), medium (m), and luminous (I) galaxies in the volume-limited sample with 
100fe~ 1 Mpc depth. The shaded 1—c region was determined from 1000 realizations with randomized marks. 
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r [Mpc/h] r [Mpc/h] r [Mpc/h] 

Fig. 5. — The conditional cross-correlation functions of early (e) and late (I) type galaxies in the volume— limited sample with 100fe —1 Mpc 
depth. The 1— a region was determined from 1000 realizations with randomized marks. 




r [Mpc/h] r [Mpc/h] 

Fig. 6. — In the left figure the k mm (r) function is shown calculated from the measured magnitudes using the Euclidean distances (solid 
line) compared to the fc mm (r) function calculated from K— corrected magnitudes using the luminosity distances. In the right plot again the 
"pure" k mm (r) function (solid line) is compared to the k mm (r) function calculated with randomized peculiar velocities (shaded area with 
dashed lines). The shaded area with solid lines corresponds to the results with randomized marks. 
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Up to now we investigated luminosity segregation in the optically selected SSRS2 catalog, with the luminosities estimated 
from the B-magnitude. To see how our results depend on the selection criteria imposed on the catalog we look at the 
mark correlations determined from the infrared selected IRAS 1.2 Jy and PSCz galaxy catalogs (for details see Fisher 
et al. 1995, Saunders et al. 2000). 

We analyze 2259 galaxies in the volume-limited sample of the PSCz galaxy catalog with a depth of 100/i _1 Mpc inside 
the mask given by Saunders et al. (2000). Similarly to Sect. 4 we use m t = r 2 /(xj) as a continuous mark, proportional 
to the luminosity of the galaxy at a distance of = |xj| with an observed flux /(xj) at 60 microns. From Fig. 7 we 
conclude that no significant luminosity segregation is present in the PSCz galaxy catalog. The same result holds for 
volume- limited samples with different depths, and for volume-limited samples extracted from the IRAS 1.2 Jy catalog. 
This confirms the results by Bouchet et al. (1993) from the IRAS 1.2 Jy and especially the investigation of the PSCz by 
Szapudi et al. (1999) who used a variant of the conditional cross-correlations discussed in Subsect. 3.1.2. Similarly, only 
a weak dependence on spectral features was reported by Mann et al. (1996) for the QDOT catalog. In Sects. 6.2 and 
6.3 we will see that the luminous early-type galaxies play a dominant role for luminosity and morphology segregation. 
This is supported by the negative results from these IRAS selected samples, since early-type galaxies are significantly 
undcrrcprcscntcd in infrared selected galaxy samples. 

There is however an interesting feature in the deeper volume-limited samples from the PSCz. Both k rnm (r) and 
var(r) are consistent with a random mark distribution, but the covariance cov(r) shows an almost three-c peak near 
r = 20/i~ 1 Mpc. This increased covariance at 20ft.~ 1 Mpc is currently beyond an explanation, however the feature is also 
visible in volume-limited samples with 200/i _1 Mpc and 300/i _1 Mpc depth, and stable against distance cuts and different 
binning. 

5. LUMINOSITY SEGREGATION VIA AMPLITUDES 

Previous investigations detecting luminosity segregation have used a sequence of volume-limited samples and compared 
the correlation amplitude of the two-point correlation function £(r) (see e.g., Willmer et al. 1998). In Subsect. 5.1 we 
show how this can be incorporated into the more general formalism provided in Sect. 2. In Subsect. 5.2 we reassess 
the arguments given by Coleman & Pictroncro (1992) showing that there is a degeneracy between a scale-invariant point 
distribution and luminosity segregation if the analysis is based on the amplitudes of £. The mark characteristics introduced 
in Subsect. 3.1 do not suffer from this artifact as shown in Subsect. 5.3. This strengthens our conclusions in Sect. 4 that 
there is indeed luminosity and morphological segregation. 

5.1. Luminosity segregation from a series of volume-limited samples 

Consider a flux-limited sample with limiting flux /i; m . Every galaxy at a distance |xj with observed flux Li/(47r|xj| 2 ) 
larger than some limiting flux /n m is included in the sample. We construct volume-limited subsamples by introducing a 
limiting depth R and a limiting luminosity Ly lm with Li; m /(47ri? 2 ) = fy lm and by admitting only galaxies with |x| < R 
and L > L\ im . In such a volume-limited sample 7 the observed number density pf R (x) = pf R is spatially constant 

/>oo 

P S i,r = P / dLpf(L), (28) 
if the underlying galaxy pattern is homogeneous. 

7 In general, we have more freedom in constructing volume-limited samples: varying R and Lij m independently, as long as the constraint: 
R? < -. j m is respected. Holding Lii m fixed, we can vary R and look, whether the statistical properties, e.g., the amplitude of the correlation 

47r J lim 

function f, differs between these samples. This would allow to test for fractal spatial structures independent from luminosity segregation. 






Fig. 7. — The mark-correlation functions for a volume-limited subsample of the PSCz catalog with a depth of lOO/i x Mpc. The shaded 
areas denote the \—a error for randomized marks estimated from 1000 realizations. 



Luminosity and morphology dependent clustering 



13 



For two-point properties we can proceed similarly. The spatial two-point density in the volume-limited samples for 
|xi| < R and |x 2 | < R is 



/>oo />OC 

P2,il( X l. X 2) = / dLi / 

JL U m JLun 



di 2 pf M ((x 1 ,L 1 ),(x 2 ,L 2 )). (29) 



Using the definition (11) of the conditional probability density <S 2 and the assumption (7) we get 

/'OO /'OC 

pf iiJ (x 1 ,x 2 )=^ 2 / dLx / dL 2 5 2 (x 1 ,x 2 |L 1 ,i 2 )pf(L 1 )pf(L 2 ). (30) 

*^ i-lim *^ -^lim 

With r = |xi — x 2 |, the two-point correlation function £jj(r) in a volume-limited sample is then 

A/" 

fr(r) + l = - -2 / dLi / di 2 5 2 (xi,X2|Li,L2)pf (ii)pf (L 2 ). (31) 

(p^ m dLpf(i)) ^ ^ 

If no luminosity segregation is present, <S 2 (xi,x 2 |Li, L 2 ) = pf (xi,x 2 )/A/" 2 and therefore: 

CflM - £(r). (32) 

If, on the other hand, the clustering of the galaxies does depend on the luminosities, the two-point correlation function 
is different between volume-limited samples of varying depths, and also differs from the two-point correlation function of 
all galaxies. 

As an illustration we calculate £fj(r) from volume-limited samples of the SSRS2 with increasing limiting depth R. Our 
results in Fig. 8 completely agree with the results reported by Willmer et al. (1998), showing a higher amplitude of £ij(r) 
for the deeper volume-limited samples. See also the comprehensive investigations of Cappi et al. (1998) and Benoist et al. 
(1999). We used several estimators for the two-point correlation function (Kerscher 1999), including the minus estimator 
shown in Fig. 8 and found that this behavior of the amplitude is independent of the estimator. 

5.2. Faking luminosity segregation 

In this section we illustrate the argument by Coleman & Pietronero (1992) who showed that there is a degeneracy 
between luminosity segregation determined with the standard method (Subsect. 5.1) and a fractal galaxy distribution. 
Indeed, a general inhomogeneous galaxy distribution can fake a sort of "luminosity segregation" . Here, we use a "fractal 
point set" as a simple, yet analytically tractable model for general inhomogeneous point distributions. 

The argument is based on the scaling behavior of the number of points inside a sample N(R) oc R D for a fractal point 
set in a sample with linear extent R, where D is the (correlation-) dimension. For a fractal point set the two-point 
correlation function behaves like 

&(r) + 1 oc R D r D ~ 3 , (33) 

with an amplitude of £r depending on the extent of the sample (for details see Sylos Labini et al. 1998). We illustrate 
this in Fig. 8 showing that fractal correlations according to formula (33) can mimic a behavior of £r as observed in the 
galaxy data. 

To summarize, the behavior of £ in a series of volume-limited samples can be explained either by a fractal point distribution 
or luminosity segregation or both. So £ does not seem to be a good method to assess one of both claims. Note, that 
Pietronero's argument is based on the assumption that no luminosity segregation is present. 




r [Mpc/h] r [Mpc/h] 



Fig. 8. — In plot (a) the two— point correlation functions £jj(r) for volume— limited samples of the SSRS2 with R = 60/i — x Mpc (solid), 
80/i _1 Mpc (dotted), 100/i~ 1 Mpc (short dashed) and 120/i Mpc (long dashed) depth are shown. In plot (b) the two-point correlation 
functions ^r(t) for a fractal with fractal dimension D = 2 are shown, with the same increasing depths R mimicking luminosity segregation. 
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5.3. Robustness of mark-correlation functions 

In the preceding section we have seen that to search for luminosity segregation employing the amplitude of £r may be 
uncertain. Now we show that the mark characteristics introduced in Subsect. 3.1 do not suffer from this degeneracy. 

All the quantities we used to investigate luminosity and morphological segregation were defined using the average 
(/)p ( r ) over a weight function /. With (/} p (r) we look at the averages of some mark-dependent weight function 
f(mi,m,2), under the condition that the points holding the marks are separated by r. We do not investigate the spatial 
distribution of the points. As can be seen directly from Eq. (13) the spatial two-point correlations are "divided out" . 
Hence, quantities like (/) p (r) are not only well-defined for homogeneous point distributions, but also give reliable results 
for inhomogeneous point distributions like fractals. 

To illustrate this we use a "fractal point set" kindly provided by Alessandro Amici. This fractal is a three-dimensional 
realization of the random-/? model with a fractal dimension of two. On a randomly selected set of points from this 
fractal we distribute marks chosen randomly out of [0, 1]. This resembles a volume-limited sample with no luminosity 
segregation. We estimate the mark-correlation functions using the estimator without boundary corrections. The function 
k mm {r) shown in Fig. 9 gives the correct result that no mark correlation is present. Hence, our methods give stable results 
even on such an inhomogeneous point distribution. This is also the case for all other functions and for any estimator 
considered (Appendix A). Therefore, our results obtained from the SSRS2 galaxy survey discussed in Sect. 4 can not be 
explained with a scale-invariant spatial distribution, showing no luminosity, alone. 

There is also a more technical advantage of our method: to estimate the correlation function £(r) one has to employ 
boundary corrections. Quantities like k mm only use conditional probabilities and may be estimated without boundary 
corrections (see Appendix A), reducing the estimators' variance. 

6. THE MORPHOLOGY-DENSITY RELATION 

The morphology-density relation states that inside clusters, in regions with a high (surface) density of galaxies, the 
abundance of early-type galaxies is enhanced whereas the abundance of late-type galaxies is reduced (Dressier 1980). 
This relation is very well established, and therefore it seems natural to ask whether the observed luminosity segregation 
can be explained by the morphology-density relation alone. In this section we present a number of reasons why this is 
not the case. 

As a first test we discarded all galaxies in a spherical region with 1.5/i _1 Mpc and also 3ft-~ 1 Mpc radius around the APM 
clusters (Dalton et al. 1997), and conduct a analysis similar to the one in Subsect. 4.1 restricted to the intersection of 
the SSRS2 and the APM cluster catalog. The mark correlation functions did not show any significant change. This may 
not be decisive, since only a few of the (rich) APM clusters are included; however, it supports our view that the observed 
luminosity segregation is not caused by clusters of galaxies alone. 

But in the spirit of the morphology-density relation, one could try to explain the observed luminosity segregation in 
the following way: the two populations of galaxies, the early- and the late-type galaxies, cluster in a different way (which 
is, e.g., manifest in the morphology-density relationship and in the observed morphology segregation Sect. 4.4). If these 
classes show different average luminosities, the morphology-density relation will generate the luminosity segregation. This 
is the main idea behind the two-species model discussed below. A first indication, that this kind of model is not able to 
explain luminosity segregation, comes from the observation, that both early- and the late-type galaxies show very similar 
luminosity distributions within the volume-limited sample we considered. 

We conduct additional tests of this idea, which allow for a further understanding of the luminosity segregation: we 
consider the two-species model in Subsect. 6.1 in more detail, and we investigate the early- and late-type galaxies 
separately in Subsect. 6.2; moreover, we look for morphology segregation in dim and luminous subsamples separately in 
Subsect. 6.3. 




r 



Fig. 9. — The k mm (r) for a fractal point distribution with random marks and number density 1000 inside the unit box. The shaded area 
marks the 1— <r range estimated from 1000 simulations, and the dotted line is the theoretical expectation, r is given in units of the box-length. 
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6.1. The two-species model 

As already outlined above, in the two-species model we consider two subpopulations of galaxies, with different spatial 
clustering and a different mark distribution. Within each class there is no mark segregation. Thus this model explains 
in a very simple way how mark correlations arise from the spatial interplay of the two classes of galaxies. The subclasses 
will be formed by early- (e) and late-type (/) galaxies. 

Let pi, rfii, Vi denote the number density, the mean mark, and the variance of the marks of galaxies of type I, respectively, 
and similarly for subclass e. The one-point mark distributions are denoted by p^ e (m) and pf f ; (m). The spatial (cross-) 
correlations are given by £ e e(?*), S,u( r ), an d £ei(r) (symmetrically defined in e and I, i.e., (£ e / + £/ e )/2). We use the 
morphological type and the luminosity as components of a compound mark m = {t,m}, where t £ {e,l} denotes the 
morphological type and m is the luminosity of the galaxy. The two-point properties within the two-species model are 
then given by: 

pl M ((xi, {h, mi}), (x 2 , {t 2 , ma})) = 

5 tie S t2e pi p&(mi)p&(m 2 ) (1+U(r))+S tl i5 t2 i pf <,(mi)^(m a ) (1+&M) 

+ (S tl eSt 2 l pfe(™l)Plf ; (m 2 ) + 6 tl l6 t2 e P^l (™l)Plfe M) Pe P l(l + 6l (»"))■ (34) 

With qi = pi/(pi + p e ), 9e = 1 — Qi, the combined two-point correlation is function 

1 + £(r) = 9e(l + U(r)) + qf(l + Zu(r)) + 2q eqi (l + £ d (r)), (35) 

and using the definitions in Sect. 3.1.1 one may calculate the luminosity correlation functions for this specific model. We 
measured q e , £ ee , as well as m e , V e etc. in the volume-limited sample with 100/i -1 Mpc depth from the SSRS2. Using these 
quantities we calculated the mark-correlation functions for the two-species model. In Fig. 10 we compare the var function 
from the two-species model with the actual observed values (similar results arc obtained for k mm and cov). Obviously, 
the two-species model is not able to explain the observed luminosity correlations. This shows that the spatial interplay 
between different morphological types, as suggested by the morphology-density relation, is only in part responsible for 
the observed luminosity segregation. A necessary ingredient is that luminosity segregation is already present in one of the 
subclasses at least (see the next section). 

The results for the two-species model shown in Fig. 10 were obtained sclfconsistently from the empirically determined 
parameters as given by the division of the sample into early- and late-type galaxies. We may go further and treat the 
two-species model as a toy model with scale-invariant (cross-) correlation functions (e.g., £ ee oc r~ 7 ) and free parameters 
m e etc. to fit the data. However, we find that an acceptable qualitative description of the observed luminosity segregation 
in terms of this model is only satisfied when the parameters of the two-species model are highly unrealistic. 

6.2. Early-and late-type galaxies separately 

As a second test, we split the lOO/i Mpc volume-limited sample from the SSRS2 into two subsamples consisting out 
of early- and late-type galaxies each. Using the luminosity as the (continuous) mark, we look for luminosity segregation 
similarly to the investigations in Sect. 4.1. From Fig. 11 it is evident that both subpopulations show luminosity segregation, 
but the main contribution comes from early-type galaxies. The late-type galaxies show a small signal in k mm only. Clearly, 
with this kind of analysis we do not pick up features intrinsic to the interplay between early- and late-type galaxies, which 
may add a further contribution to the observed luminosity segregation (Fig. 2). 




r [Mpc/h] 

Fig. 10. — The mark-correlation function var(r) for a volume— limited subsample of the SSRS2 with a depth of 100fc _1 Mpc (solid line) 
compared with the mark— correlation function calculated from the two— species model (dashed line). The shaded area denotes the 1— a error for 
randomized marks estimated from 1000 realizations. The inset compares the case of no luminosity segregation (dotted line) and the prediction 
of the two-species model (dashed line) 
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Fig. 11. — The mark— correlation functions for a the early— type and late-type galaxies from the volume-limited sample of the SSRS2 with 
a depth of 100/i _1 Mpc. The shaded areas denote the 1-cr errors for randomized marks estimated from 1000 realizations. 
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6.3. The other way round? 

So far, our results show clearly that the luminosity segregation is not a pure effect of the morphology segregation. 
To investigate the opposite case, where the morphology segregation is caused by the luminosity segregation, we split the 
volume-limited sample with lOO/i^Mpc depth into two equally sized luminosity classes, with dim and luminous galaxies, 
respectively. For each of these samples we calculate the conditional cross-correlations between early- and late-type 
galaxies. The strong (conditional) correlations C ee (r) of early-type galaxies on small scales are now only visible in the 
sample of luminous galaxies, confirming the trends reported by Willmer et al. (1998). The conditional anticorrelation 
indicated by the C«(r) of the late type galaxies on small scales is present in both subsamples but more pronounced in 
the sample of luminous galaxies (only C ee (r) is shown in Fig. 12). This test does not allow very strong conclusions, since 
it is based on an ad-hoc division of the whole sample. A finer division is not feasible, since very few early-type galaxies 
will populate the subsamples. However, our results strengthen the interpretation that both sorts of mark correlations are 
irreducible. Neither is the luminosity segregation the source of morphological segregation nor is it the other way around. 
In particular, the luminous early-type galaxies cluster more strongly than all other galaxies. 

7. SUMMARY AND OUTLOOK 

The investigation of luminosity and morphology segregation of galaxies has been a scientific task for many years. Our 
results allow for a new perspective and suggest that both the methodology and the physical interest should shift slightly. 

Methodologically, we discussed luminosity and morphological segregation in the framework of marked point processes. 
This perspective provides us with a unifying view on morphology and luminosity segregation. Moreover, the mathematical 
theory of marked point processes provides us with test quantities and models to be compared with the data. In this line 
we discussed the mark-weighted conditional correlation functions. These functions are not only easy to estimate, but also 
offer a clear interpretation. They may be applied to a single volume limited sample, a sequence of volume limited samples is 
not necessary. As a consequence, they break the degeneracy between a fractal spatial structure and luminosity segregation. 
We suggest that the k mm , var, and cov functions are of special interest for a first test on luminosity segregation. Since 
several bias-models assume scale-dependent bias, we need quantities like k mm , var, and cov which can unfold the scales 
at which mass or luminosity segregation is relevant. This is not possible by looking at the amplitude of the two-point 
correlation function £ij(r) alone. Moreover our method allows for a "built in" significance test, by randomly re shuffling 
the marks. The conditional cross-correlation functions seem to be useful if mark segregation has already been shown 
to be present and is to be understood more closely. However, they are based on a division of the whole sample into 
subpopulations, a division that has to be done carefully The conditional mark-correlation functions are rather flexible. 
With the peculiar velocities or the orientations of galaxies treated as marks, the conditional mark correlation functions 
will allow for a fresh look at the pairwise velocity dispersion and on alignment effects. Our methods can be easily extended 
to higher-order correlations. In a forthcoming work we will study the mark correlations using higher-order statistics as 
the J-functions (van Licshout & Baddeley 1996, Kerscher 1998). 

Concerning the physical results, we were not only able to assess luminosity segregation as well as morphological seg- 
regation. Rather, our perspective allowed us to ask the question: What is the luminosity and morphological segregation 
like? Our main results obtained from the SSRS2 survey are: 

• The average luminosity of pairs of galaxies and the fluctuations in the luminosity on each galaxy is enhanced for 
pairs closer than 15ft. _1 Mpc. Hence, luminosity correlations are scale-dependent, and they are significant even 
outside clusters of galaxies. On scales larger than 15/i _1 Mpc our results indicate that neither luminosity nor 
morphological segregation is present. 




Fig. 12. — The conditional cross-correlation function C ee (r) of early-type galaxies in the luminous and dim subsamples. The 1-a region 
was determined from 1000 realizations with randomized marks. 
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• The luminosities of galaxies in pairs closer than 2>h ^^Mpc show an increased covariance - close galaxies preferably 
have similar luminosities. 

• The luminosity segregation is not compatible with the random field model. Thus, the luminosity does not trace 
an underlying independent random field. The luminosity of a galaxy depends on the local clustering and on 
interactions with other galaxies. 

• There is an interesting feature, a small peak, in fc mm , vox and cov for galaxy pairs with a separation of 
approximately 10/i _1 Mpc, which is currently beyond an explanation. 

• We observe morphological segregation between early- and late- type galaxies for scales smaller than 10/i _1 Mpc. 
This effect is mainly due to highly luminous galaxies. Especially the luminous early-type galaxies seem to play an 
important role, both for luminosity and morphology segregation. 

• The importance of early-type galaxies for luminosity segregation is confirmed by our analysis of the IRAS samples. 
These infrared samples exhibit a deficit in early-type galaxies and consequently show no luminosity segregation. 

• An inhomogeneous, scale-invariant galaxy distribution, but without luminosity segregation, can not account for 
the signal seen in k mmi var, and cov. The lowered correlation of the dim galaxies, and the enhanced correlation 
of the luminous galaxies we found, explains at least in part why the amplitude of the correlation function rises if 
deeper, i.e., more luminous, galaxy samples are considered. 

• With several independent tests we could show that it is not possible to explain the observed luminosity segregation 
from the morphology-density relation alone. 

Nevertheless, a couple of question remain open. 

Concerning the data, it seems important to confirm our results using other galaxy surveys. Also the influence of redshift 
space distortions and of galaxy clusters should be investigated beyond the simple error-estimates presented in Subsect. 4.5 
and Sect. 6. 

Our methods are directly applicable to volume-limited samples, similar to the usual way of assessing luminosity segre- 
gation, where one needs a series of volume-limited samples. Using models for the conditional mark density M2 or the 
mark-correlation functions one may determine the parameters of such models from magnitude-limited surveys directly. 
Similarly, the influence of mark segregation on the two- and iV-point correlations estimated from magnitude-limited 
surveys can be estimated. 

Closely related is the question how strongly the deprojected two- and iV-point correlation functions, determined from 
2-dimensional galaxy catalogs, are influenced by luminosity segregation. With models for the mark-correlations a refined 
Limber's equation may be constructed (see e.g., Gardini et al. 1999). Both, the concerns about magnitude-limited surveys 
and deprojection formulas will be addressed in future work. 

In this article we focused on clarifying the mathematical framework, on the data-analysis, and on the interpretation 
of the observed luminosity and morphological segregation. The relation to the peak-formalism (Bardeen et al. 1986) and 
other biasing schemes will be investigated in future work. Understanding the luminosity distribution on the galaxies from 
dynamical models is the major goal. 
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APPENDIX 

ESTIMATORS FOR MARK-CORRELATION FUNCTIONS 

In this section, we discuss estimators for the weighted mark-correlation functions. For this purpose, let {(x^m^)}^ 
denote the N empirical data points Xj inside the sample T> with their marks m,. We prefer estimators which are unbiased 
and show small variances. For a detailed discussion of two-point estimators see (Kerscher 1999). One basic idea is to 
construct estimators for (/} p (r) from a combination of estimators for the numerator and for the denominator of eq. (13). 
We first discuss estimators of this type, but then introduce a different estimator, which does not use any boundary 
conditions. It turns out, that in our case, this estimator is unbiased and is recommended by its simplicity and low 
variance. 

Construction of the estimators 
To calculate the correlation functions in bins of width A, we use the indicator function of a set A 

»*«-{J othe^se, < A1 > 

and the reduced sample window 2?_ r = {x G P|rf(x, dT>) > r} shrunken by r. 

- — - M 

Using these definitions, the ratio-unbiased minus estimator (/) p (r) for the weighting functions / (mi, 777,2) (compare 
cq. (13)) is simply 

,-7: M , . _ E^j=l lP- r (Xi)l[ r , r+ A](|Xt -Xj|) .f(777l,777 2 ) 

U/p ( r ) - =jv " — - 7 [7 » ( AZ ) 

where the indicator function 1- D _ r (x i ) assures that the point x» is further than r from the boundary (for details see 
Kerscher 1999). 

In the minus estimator the window is effectively shrunken, resulting in an increased variance. On the contrary, the 
following estimator uses all point pairs Xj,Xj, however weighted with an geometrical weight w(xj,Xj). Such weighting 
schemes lead to ratio-unbiased estimators for the two-point correlation function (for details see Stoyan et al. 1995). The 
straight-forward generalization of these concepts results in ratio-unbiased estimators for (/) p : 

TTi", \ _ X)£j=l jW+A](|Xj ~ Xj|) fafoi.Xj) /(mi,777 2 ) 

\J)p\ r )- 7=^ Z 7, 7 ; \ • ( A6 ) 

Ei^=l l[r,r+A](|Xi -Xj-I) Uifaxj) 



Using the weight 



w(x i ,x,-) = 1 — r, (A4) 

v 3> PnP x ,._ x J' v ' 



we arrive at an estimator (f) P (r) suggested by Stoyan & Stoyan (1994). In full analogy to the estimators for the two-point 
correlation function other weights, like the Ripley (Rivolo) weight or the isotropized version of eq. (A4), can be used (for 
details see Kerscher (1999)). 
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Beisbart & Kerscher 



Instead of estimating (/) p with unbiased estimators for the numerator and for the denominator in Eq. (13) separately, 
we suggest to simply use the ratio 



This is motivated by the observation, that (/) P is calculated from the marks under the condition that the two points 
are separated by r. Indeed we are not investigating the spatial distribution of the points, but "divide spatial two-point 
properties out" . Unfortunately, the unbiasedness of this estimator cannot be proven with the common methods used in 
the theory of point processes, but it seems intuitively clear that this estimator is unbiased. In sect. A. 2 we show this 
using a numerical example; we illustrate furthermore that this estimator has preferable variance properties (this was also 
observed by Capobianco & Rcnshaw 1998). 



We use the marked Poisson process discussed in Sect. 3.2 to numerically investigate the properties of these estimators for 
the continuous mark-correlation functions. The sample mean of the estimators coincide with the theoretical mean value 
for all estimators. Thus, empirically, all estimators are unbiased. In Fig. A13 the variances of j(r)/V for the different 
estimators are shown. The variance of the minus estimator becomes unacceptably large especially on large scales. The 
estimators using a weighting with the set covariance or the isotropized set covariance show the same small variance, even 
smaller than the variance of the estimator using a weighting of Rivolo (Ripley) type. A detailed inspection shows, that 
the estimator using no boundary correction typically gives the smallest variance. A qualitatively similar behavior is found 
for the other mark-correlation functions. Therefore, and for reasons of computational simplicity, we mainly apply this 
estimator. We suggest to use it for all mark-weighted correlation functions as the natural and unbiased choice. 



</> P (r) 



Ei^j=i %y+A](|xj -Xj|) f(m u m 2 ) 

£jy=l l[r,r+A](|Xi -Xj|) 



(A5) 



Comparison of the estimators 
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Fig. A13. — The standard error estimated from 5000 realizations for the ~f(r)/V is shown: minus estimator (solid line), Rivolo (Ripley) 
estimator (dotted line), the other weighting estimators and the estimator without boundary correction lie nearly on top of each other (the 
lowest line). 



